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« 

Ignorant Belief Propagation Decoder ? » Nov. 2003 

• ■ 

* 

Field of the Invention 

The present invention relates to a method for decoding at least one codeword comprising 
N code bits in a decoder. The codeword having been generated in an encoder using a 
set of M parity equations presentable as a parity check matrix. Further, the present 
invention relates to a decoder as well as to a mobile terminal and base station employing 
the decoder. Moreover, the present invention relates to a communication system in 
which a mobile station and/or a base station according to the invention is/are used. 

Related Art 

♦ 

» 

• • • 

Low-Density Parity-Check Coding 

■ 

Errpr correcting codes are widely utilized to obtain reliable communications over noisy 

■ 

channels. Generally speaking, a linear error correcting code C can be described by a 
parity-check matrix H satisfying Hx = 0 for any codeword xeC. H is an M x N matrix 
where N is the size of a codeword and M is the number of linear constraints that must be 
satisfied by each code word. Each row of H therefore represents a linear homogeneous 
parity-check equation. 

Low-density parity-check (LDPC) codes are a particular class of linear error correcting 
codes characterized by a highly sparse parity check matrix. Typically, in a matrix having 
a relatively large row length, the entire row may consist of just three ones, the remainder 
being zeroes. The number of ones in a row m is also called the row weight pm, while the 
number of ones in a column n is called the column weight Xn- If row weight and column 
weight are independent of the particular row or column, i.e. pm=p and Xn=x for all m and 
/?, the code determined by H is called a regular code. Otherwise it is called an irregular 
code. 

LDPC codes were originally introduced and investigated by Gallager in 1962, (see 
Gallager, "Low-density parity-check codes", IRE Transactions on information Theory, 
Vol.. IT-8, pp. 21-28, 1962). A problem of using low density parity check matrices has 
been to provide a method of decoding, and one of the most significant features of 
Gallager's work is the introduction of iterative decoding algorithms. He showed that, 
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when applied to sparse parity-check matrices, such algorithms are capable of achieving 
a significant fraction of the channel capacity in a communication system at relatively low 
complexity. Furthermore* the number of computations per bit per iteration is independent 
of the block length N. 

Since Gallager's. prominent contribution, LDPC codes have been rediscovered and 
further investigated by Tanner, Wiberg, MacKay and Neal and others. Details of these 
investigations may be found in Tanner, W A recursive approach to low complexity code", 
IEEE Transactions on Information Theory, pp. 533-547, 1981, and MacKay et al., "Near 

■ 

Shannon limit performance of Low-Density Parity-Check Codes", IEEE Electronic. 
Letters, vol. 32, pp. 1645-1646, 1996. 

■ 

.Belief Propagation 

mm 

ft 

Known decoders include the maximum likelihood decoder and the maximum a-posteriori 
decoder. The more widely used of the two, the maximum-likelihood decoder involves 
finding a most probable information word (where the likelihood is dependent on the 
channel model). The maximum a-posteriori decoder differs from the maximum likelihood 
decoding in that it provides an a posteriori probability for each symbol. A problem, 
however, is that the maximum a-posteriori decoder is typically computationally more 
complex than the maximum-likelihood decoder. 

■ 

Gallager therefore proposed the iterative decoding scheme referred to above, based on 
the (later termed) belief propagation method, which approximately converges to the a 
posteriori probability of each symbol, 

* * ■ 

The method relies on a graph-based representation of codes, where the decoding can be 
understood as message passing in a factor graph. Belief propagation produces exact 
probabilities in case of a non-cyclic graph. Unfortunately, the graph associated with an 
LDPC code is usually cyclic and therefore belief propagation may produce inaccurate 

* 

probabilities. Nevertheless, Gallager's decoding algorithm gives good empirical 
performance since, in particular, the end product is the decoding, and so the posterior 
probabilities need not necessarily be exact. 

Sum-Product Algorithm 

A brief description of the sum-product iterative algorithm follows. For brevity of 
exposition, we consider the binary case. The extension to the non-binary case should 
impose no problem to those skilled in the art, and can be found for example in Davey et 
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al, "Low-Density Parity. Check Codes for GF(q)", IEEE Communications Letters. Vol. 2 
Mo. 6, June. 1 998. Based on the finding that LDPC codes provide a near-Shannon 
performance when decoded using a probabilistic decoding algorithm, Dayey et al. 
present empirical results of error-correction using the analogous codes over a Galois 
Field GF(q) for q>2 for different channel models! 

. * * ' • . * * * 

* • * . 

■ 

More detailed discussion about graphs and the sum-product algorithm, as well as further 
. simplifications for binary variables and parity checks, can be found in KsChischang et al., 
"Factor Graphs and the Sum-Product Algorithm", IEEE Transactions on Information 
Theory, Vol. 47, No ? 2, February 2001. Kschischang et al. disclose a generic message 
passing algorithm, the sum-product algorithm, operating in a factor graph. A factor graph 
is a bipartite graph visualizing the factorization of complicated global functions of many 
variables. ..." 



mi 



A simplifying characteristic of the binary case is. that since there are only two possible 
events, the event probabilities can be expressed in terms of a log-likelihood ratio (LLR), 
which is generally defined by : 

LLR = In = In p(x = 1) m 

as. the. natural logarithm of the ratio of probabilities that x is one of the two possible 
events. 

♦ 

The algorithm .has two alternating components commonly referred to as the horizontal 
and vertical steps. More specifically, two binary distributions or message, matrices, ^t™ 

r m a 

and B mn associated with the non-zero eleritents h™, of the sparse parity-check matrix H, 
are iteratively updated. The quantity a™ represents the LLR of the nth bit of the 
transmitted codeword, given the information obtained from all the parity equations other 
than the m equation. In a similar manner, fi mn represents the LLR for the satisfaction of 
the m m parity-check equation given the LLR of the n" 1 bit and all the other bits are 
statistically independent, with associated distributions 0 m i...B mN . Assuming that the 
codewords are used, with equal probability oh an arbitrary binary-input continuous-output 
channel, the sum-product algorithm can be described as follows. 

Before summarizing the algorithm, some terms iised in the following sections are defined 

• • * # 

first The terms are described within the error decoding context.. Fig. 1 shows a sample 
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parity-check matrix H, together with a graph representation of the matrix which may be 
used to confer the fojlowing definitions. 

A Check Node represents one parity check bit. A parity check bit is generally computed 
from one or more information bits.such that a given equation is solved. In binary logic, an 
equation might be represented, by the modulo-2 sum of information bits, where the 
results should be equal to the parity check bit. 

t 

A Variable Node represents one coded bit. In communication decoding a coded bit is 
usually equivalent to the received value of a code bit, or for example a log^likelihood 
ratio. A Variable Ncde is connected to one or more Check Nodes, which represents the 
relation of that variable to the respective parity check bit. In other woFds, a variable 
participates in all the equations of connected Check Nodes. 

An edge between a Variable. Node and a Check Node is used to represent a relation 
between these. On the Variable Node side the edges to Check Nodes give information 
which check equations involve that variable. On the Check Node side the edges to 
Variable Nodes give information which variables are involved in that particular parity 
check equation. . 

In the decoding process a message is passed along the edges from Variable Node to 
Check Node, and also from Check Node to Variable Node. The message typically 
contains some sort of belief or probability information (hence "belief propagation" is 
widely used in literature). 

The Sum-Product algorithm may be defined by the following steps: 



Initialization 



X n represents the a priori LLR of the nth bit of the transmitted codeword. This. LLR can be 
calculated from the received vector corresponding to the transmitted codeword and the 
channel model. For each non-zero entry h mn of the parity-check matrix H. set: 



Horizontal step 



(2) 



For each non-zero entry. h mn of the matrix H, p m „ is computed using the equation: 
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A nn =2>tanh- , n tanh 



a 



ml 



(3) 



where / runs over the non-zero bit positions of the m 01 parity equation (i.e. h m i*0), 
excluding the n m position. 

« 

Fig. 2 shows a graph representation of an exemplary parity check matrix 



H = 



fl .1.0 0 1 0^ 
0 110 0 1 
10 110 0 
111111 



The horizontal step can be visualized according to Fig. 2 as fojlows. Whenever a p mn is to 
be calculated for a given edge mn connecting Check Node m to Variable Node h, all a 
values on edges are involved which are connected to Check Node m except the a value 
which belongs to edge mn, i.e. a™. 



Vertical Step . 

• ■ • 

- • . 

For each non-zero entry h mn of the matrix H, update a™ in the following manner: 



(4) 



where j runs over the parity equations for which h Jn *0. 

■ 

Decoding 

# * 

A single iteration typically consists of an application of the horizontal step and then of an 
application of the vertical step (except for the first iteration where additionally a™ is 
initialized based on the symbols received from the channel). At the end of any iteration 
(including the initialization step) one can also update the soft-output decision (i.e. the 
estimated posteriori LLR £,) of each bit 



(5) 



where j runs over the parity equations for which h Jn *0. Using equation (5) the value of the 
kth transmitted bit can be estimated as 
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. fi ift„>o 
* k to i%„<0 



o if.K* 2X<<> 



In this manner a tentative bit-by-bit decoding is performed and a vector x is obtained. If 
Hx=0, i.e. if £ is a codeword, the decoding algorithm halts declaring x as the output. 

a 

Otherwise, the iterative process continues by returning to the horizontal step above. The 
decoding procedure terminates by declaring a decoding-failure, or if some maximum 
predetermined number of iterations (e.g. 100) occurs with no successful decoding. 

Min-Sum Algorithm 

To simplify the calculations involved, equation. (3). in the horizontal step may be 

* m 

approximated and substituted by 

■ . 

^=nunK/|)-n s g n ( ar !»')' < 7 > 



This approximation will degrade the performance of the decoding however. 

WO 02/37731 A2 provides an implementation of the sum-product algorithm which uses 
different sets of equations to achieve the horizontal step, vertical step, and decoding. 

• • 

More particularly, the reference employs a likelihood difference as also defined by 
Kschischang et al. to perform the calculations of the horizontal and vertical step. 

* 

As can be seen from the equations, above for the horizontal step, vertical step, and 

* « 

decoding, the information from numerous values is involved which is ultimately derived 
from the received vector corresponding to the transmitted codeword. In a noisy channel 
environment, chances are high that several received values (bits) carry wrong 
information, which implies that wrong information , can be inferred from these values and 
propagate through the decoding iterations. 

* 

♦ 

Summary of the Invention 

It is therefore the object of the present invention to reduce the influence of wrong 
information in an iterative decoding method. 
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* 

The object of the present invention is solved by the subject matter of the independent 
claims. Preferred embodiments of the present invention are subject matter to the 
dependent claims. 

In the following, the terminology used in the introduction and by Kschischang et ai. has 
been retained to facilitate the comprehension of the present invention. According to the 
present invention a message matrix may be a rectangular matrix which holds generally 
real values representing the messages about a certain coded symbol. The message 
itself may be a knowledge-related, belief-related, or probability-related measure. 
Generally the position within the matrix gives information about the concerned coded 
symbol, as well as about how the message is obtained. In a preferred embodiment the 
row index denotes the parity check equation which is relevant for the message, while the 
column gives information about the coded symbol for which the message is valid. 

• ■ 

According to an embodiment of the present invention a method for decoding at least one 
codeword x comprising N code bits in a decoder is provided. The codeword x may have 
been generated in an encoder using a set of M parity equations presentable as a parity 
check matrix H . According to the method, for each non-zero entry in a parity check 
matrix H , the elements of a first message matrix may be initialized with data X 

n 

obtained from a demodulator. Next, for each non-zero entry in the parity check matrix H , 
the elements fi^ of a second message matrix may be determined based on elements. 
a mn °f sa'd first message matrix, and a decoded codeword x may be reconstructed 
based on the data X n obtained from the demodulator and the elements of the 
second message matrix. According to this embodiment, only a subset of message matrix 
elements from said first message matrix may be used for determining a message 
matrix element /3 m of said second message matrix, wherein the message matrix 
elements of said subset fulfill a reliability criterion. 

♦ 

According to the method, only reliable message matrix elements of the first message 
matrix, e.g. the elements a m , may be used to determine the message matrix elements 
Pm, °f a second matrix. Taking the example of the Sum-Product algorithm as outlined 
above, in any of the equations of the horizontal step and/or vertical step, not all 
information may be processed. Instead some of the values, i.e. message matrix 
elements may be excluded from the calculations. Which values are excluded may be 
determined according to criteria as outlined further down below. Generally a value may 
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be excluded if it is unreliable such that the inclusion of the term would produce worse 

* 

results than its omission from the respective equation. 

Further, the message matrix elements of the first message matrix may be updated 

• • • 

based oh a subset of message matrix elements ^ of said second message matrix, 

wherein the message matrix elements of said subset fulfill a reliability criterion. This may 

for example be applicable in case it has been decided to perform several iterations 

• ■ 

* * 

before trying to decode a codeword. Hence, when considering the example of the Sum- 

Product algorithm again, the calculations of the values in the vertical step may be 

■ ■ 

performed' on a reduced set of elements p^ . 

* • • 

In the embodiment above only the message matrix elements P mt of the second message 

■ ■ • • 

* * • 

matrix may. be updated. According to a further embodiment it is also possible to update 

• • • * ■ 

only the message matrix elements based on a reduced set, i.e. a subset of message 
matrix elements:^;. 

Therefore, the present invention further provides a method for decoding at least one 
codeword x comprising N code bits in a decoder wherein the codeword x may have 
been generated in an encoder using a set of M parity equations presentable as a parity 
check matrix H . According to this embodiment, for each non-zero entry in a parity check 
matrix H 9 the elements of a first message matrix may be initialized with data X n 

obtained from a demodulator. Next, for each non-zero entry in the parity check matrix H \ 
the elements p m of a second message matrix may be determined based on elements 

of said first message matrix, and a decoded codeword x may be reconstructed 

based on the data X n obtained from the demodulator and the elements p^ of the 

> .... 

second message matrix. Further, for each non-zero entry in the parity check matrix H , 
the message matrix elements of the first message matrix may be updated based on 

message matrix elements p^ of the second message matrix, wherein a subset of 

■ ■ * 

message matrix elements 0^ of said second message matrix may be used to update a 
message matrix element of said first message matrix, wherein the message matrix 
elements of said subset fulfill a. reliability criterion. 

• • ' • • • . • • • 

♦ * • 

According to a further' embodiment of the present invention, only a subset of message 

* « 

matrix, elements of said first message matrix is used for determining a message 
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■ 

matrix element p mn of said second message, matrix, wherein the message matrix 
elements" of said subset fulfill a reliability criterion, 

♦ • • 

• * ■ 

In another embodiment, the elements of the first arid/or the second message matrix may 
be recalculated in several iterations before the decoding method tries to decode the 
received code bits for the first time. Hence, the method. proposed may further comprise 

■ * 

the step of performing iterations by repeating the determination of the message matrix 
elements fi m of the second message matrix. 

■ 

i * 

In a further embodiment, it may be repeatedly tried to decode the code bits received. 
Thus, the iterations may further comprise reconstructing a decoded codeword x based 
on the data X n obtained from the demodulator and the elements p m of the second 

message matrix in each iteration, * 

« - . • 

In order to determine, whether the reconstructed codeword Is a valid codeword, it may be 
checked whether the parity check equations of the parity-check matrix H are satisfied by 
' the reconstructed decoded codeword x . 

The iteration through the different processing steps as outlined above may be stopped 
upon reaching on predetermined number of iterations or in case the decoded codeword 

• ■ 

5. satisfies the parity check equations. . 

In another embodiment of the present invention, the data obtained from a demodulator 
may compnse parameters representing one of a likelihood ratio,, a likelihood difference or 
a probability for each of the N code bits of a codeword x. thus, different measures or 

■ 

parameters may be used in the proposed method to calculate the different elements of 
the first and second message matrix. 

* 

Further, the data obtained from the demodulator may further, comprise indications which 
of the parameters provided fulfill the reliability criterion. 

. 

According to a further embodiment of the present application, the subset of message 
matrix elements p± of said second message matrix used to determine the message 
matrix elements, of^ of said first message matrix may be updated upon determining new 

» 

message matrix elements p^ in an iteration step. This allows adapting the decoding 
method to a possibly redefined reliability criterion in each iteration step. 
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When updating the subset, the updated subset may therefore only comprise message 
matrix elements of the second message matrix fulfilling a reliability criterion, e.g. a 
criterion updated during the different possible iterations in the decoding process. 

In another embodiment of the present invention also the subset of message matrix 
elements of said first message matrix used to determine the message matrix 

elements fi^ of said second message matrix may be updated upon determining new 

message matrix elements in an iteration step. 

When updating the subset, the updated subset may comprise only message matrix 
elements of the first message matrix fulfilling the reliability criterion. 

According to a further embodiment, the reliability criterion may be based on at least one 

. of channel estimations of a radio channel via which the codeword x has been received, 

» 

the absolute values of the elements of the first and/or second message matrix, the 
absolute values of the data provided by the demodulator, the number of the iteration in 
the decoding which have already been processed, the maximum number of iterations to 
be performed in the decoding process, and a random process. 

It may be determined that the reliability criterion is not fulfilled by a message matrix 
element of the first or the second message matrix, if the signal to noise ratio for the 
element and/or thfe absolute value of the element is below a predetermined threshold 

i 

value. 

According to this embodiment, it may be for example possible, to use the channel 
estimations of the radio channel as a basis for deciding which of the initialized message 
matrix elements of - the first message matrix are added to the subset used to 

determined the message matrix elements ' of the second message matrix. Next, 

when updating either the first or second message matrix or both, the absolute value of 
individual message matrix elements may build the basis for the reliability criterion to 
define the subset for updating. Also the number of iterations already performed may 
influence the reliability criterion. 

In a further embodiment of the present invention, the error correcting code used is a low- 
density parity-check (LDPC) code. 
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Another embodiment of the present invention is related to a decoder. The decoder may 
be used for decoding at least one codeword x and may comprise processing means for 
initializing the elements of a/first message matrix for each non-zero entry in a parity 

check matrix H yvith data X n obtained from, a demodulator, for determining the elements 

.... . ...... 

Pmn of a second message matrix for each non-zero entry in the parity check matrix H , 

• • • 

based on elements a^. of said first message matrix, and for reconstructing a decoded 

■ » * 

• • • • • 

codeword x based on the data X n obtained from the demodulator and the elements B 

of the second message matrix, 

■ ' . ■ 

Moreover, the processing means may be further adapted to use a subset of message 

* * * ' • 

matrix , elements from said first message matrix for determining a message matrix 

• • . • . 

element @ m of said second message matrix, wherein the message matrix elements of 
said subset fuffill a reliability criterion.. 

According to an alternative embodiment of the present invention, a decoder for decoding 
at least one codeword x may comprise processing means for initializing the elements 

• * * 

.a m of a first. message matrix for each non-zero entry in a parity check matrix H with 

• • • . 

data. X n obtained from a demodulator, for determining the elements /3„ of a secpnd 

. ' • a ... 

message matrix for each non-zero entry in the. parity check matrix H, based on 
elements of said first message matrix, and for reconstructing a decoded codeword 

x based on the data X n obtained from the demodulator and the elements p m of the 
second message matrix, and. for updating the message matrix elements of the first 
message matrix for each non-zero entry in the parity check matrix H based on message 
matrix elements of the second message matrix. 

Further the processing means may be adapted to use a subset of message matrix 
elements fi m of said second message matrix tb update a message matrix. element 
of said first message matrix, wherein the message matrix elements of said subset fulfill a 

* 

reliability criterion. . 

■ 

« 

The two alternative , implementations of the decoder mentioned above may be further 
adapted to perform the decoding methods described above. . 
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- ■ 

In other embodiments, the present invention provides a mobile terminal and a base 
station in a mobile communication system, both comprising receiving means for receiving 
at least one codeword x, demodulation means for demodulating the at least one 
received codeword x and for data to a decoder, and a decoder as described above. 

The mobile terminal and/or the base station may further comprise coding means for 
encoding data in at least one codeword x , and transmission means for transmitting the 
at least one codeword x , and in that at least one transmitted codeword x is suitable for 

decoding according to the different decoding methods described above. 

* * ... 

* . 

Moreover the present invention further provides a mobile communication system 
comprising at least one base station and at least one mobile terminal. 

Brief Description of the Figures 

In the following the present invention is described in more detail in reference to the 

attached figures and drawings. Similar or corresponding details in the figures are marked 

« 

with the same reference numerals. 

Fig, 1 shows a sample parity-check matrix H, together with a graph representation of 

* * 
the matrix, 

Fig. 2 shows the graph representation of Fig. 1 together with the messages a™ and 

■ » 

p mn which are passed along the edges in belief propagation algorithms, 

Fig. 3 shows a flow chart of an exemplary decoding process according to an 

embodiment of the present invention, 

Fig. 4 shows a flow chart of another exemplary decoding process according to an 

embodiment of the present invention, 

4 

■ * 

Fig. 5 shows a transmitter and a receiver unit according to an embodiment of the 

present invention, 

Fig. 6 shows a mobile terminal according to an embodiment of the present invention 

comprising the transmitter and the receiver shown in Fig. 5, 

■ 

Fig. 7 shows a base station according to an embodiment of the present invention 

comprising the transmitter and the receiver shown in Fig. 5, and 
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* 

Fig. 8 shows an architectural overview of a communication system according to an 

embodiment of the present invention comprising a mobile terminal shown in. 
Fig. 6 and a base station (Node B) shown in Fig. 7. 

* 

Detailed Description 

■ 

In the following description of the different embodiments of the present invention the 
expression "xe A\B" denotes "x is element of set A without set B", which is equivalent 
to "x is element of set A but not element of set B D . Further, the following paragraphs will 
outline the ideas underlying the present invention by way of example considering LDPC 
decoding. However, it should be noted that the principles underlying the present 
invention may also be. applicable to other codes. 

* 

As outlined before, mathematical equations may be solved in the horizontal step, vertical 
step, and decision step. At least the horizontal step and vertical step equations are 

« * * 

computed in each iteration, such that it would be formally correct to refer to e.q. a m and 

m 

P™ , where / represents the iteration number, and the initialization step for may be 

• m 

I 

interpreted as iteration number zero, i.e. a™ . However for sake of simplicity and brevity 
an iteration superscript has been omitted fromthe formulas. 

• • • 

Generally, it should be noted that a values are necessary to compute p values in the 
horizontal step. Likewise it should be noted that p values are necessary to compute a 
values in the vertical step as well as to compute £ values in the decoding process. 

A new p^ value, i.e. a new message matrix element, is computed from a ml values 

where / takes all values from 1 to N where the parity-check matrix entry h m) is not zero, 
except n. This can be interpreted as / being element of a set L mn . 

• ■ • 

L m = \le[l,n-i\v[n+hN]\h ml *o} (8) 

* 

Lmn represents the set of values ten between 1 and N for which h m f*0. 
Using equation (8) the horizontal step may be reformulated: 

* • m 

^ (Ba =2.tanh- , ntanh^ L (9) 
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* 

or alternatively according to equation (7) approximated and simplified to 

* 

^=n^nK/|)Il Sgn(a - ) (10) 

■ • 

• • * 

Similarly there may exist a vertical step set Jmn which can be defined as follows: 

♦ i * ■ 

* • 

* • 

Jmn may be interpreted as a set of values fern between 1 and M for which h jn *0. 
With equation (1 1) the vertical step can be rewritten as 

J- 

• • * 

According to the present invention, exclusion sets r,^ and Cl^ may be defined for the 

• * 

. • • • 

horizontal and vertical steps. The exclusion set may. comprise message matrix elements 

which are not considered When determining or. updating the message matrix elements 

of the vertical step and/or the message matrix coefficients fi^ of the horizontal step. 

• • • . * 

* 

A. new horizontal step may be defined as: 

» 

p m *2.*H* n ., . (13) 

* 

or alternatively approximated and simplified to 

a.-»$(M- EM*-) (14) 

. - 

A new vertical step may be chosen as follows: 

'"»-*.+ ' • ' < 15 > 

• • * 

If both sets r and n^, are empty, prior art behavior is replicated. If contains the 
same elements as L mn and/or Q^, contains the same elements as J™ for all possible 
values of m and ri, the result would be no message propagation at all, which is 

«... ■ • 

equivalent to ho decoding. 
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The situation where r^, contains the same elements as L mn may occur for arbitrary 

♦ 

values of m and n. In such a case, the respective p^ values in the horizontal Iteration 
step may be set to zero. 

In case I*..' contains the same elements as L mn for all values of m and n, all fi m values 
may be set to zero. Consequently the next vertical step may be interpreted as a re- 

■ ■ 

initialization of the (see equation (15)), i.e: setting all = \ .. Thus, in such a case 
the decoded codeword x may correspond to a decision based directly on X n (see 

■ - • 

. equation (6)). From a technical point of view this may be regarded equivalent to not 

decoding the inputted data, but to simply pass them to the next processing entity. It 

• * . ,i 

should be noted that in case contains the same elements as L m '„ for all m and n, 
according to. equation (15) the calculation of i - a^ becomes independent from the 

• * * . 

exclusion set £1^ , as any p^ element involved would have been set to zero In this 

case also no effective message propagation among Nodes is performed. 

• ■ 

Conversely, the initialization step may be. viewed as an instance of a single new vertical 

... ■ • ... - t . . 

step where the exclusion set Gl^ contains the same elements as j mn . Alternatively the 

initialization step may also be viewed as an instance of a single vertical step where all 

* * * * * * * 

values are equal to zefb. ; 

- . 

* t • . • « ■ 

Generally the exclusion sets are depending on the reliability criteria, and therefore can 

• * * 

depend on parameters such as the row index m for which an equation is solved, the 
column index n for which an equation is solved and/or the iteration / of the whole 
decoding algorithm. Further, the exclusion sets may be updated during the decoding: 
process in dependence on decision criteria further outlined below. 

» * 

* 

• ■ 
• • • 

* 

As an example, in the horizontal step the message matrix element in iteration step / 

(see Fig. 2) may be determined by calculating 

■ 

♦ - 

♦ • * 

m • 

assuming that is empty and 1!^ ={2,6}. in case it is determined that a newly 

- 

calculated. does not fulfill the reliability criterion, e.g. |or|J < ag 0 * 0 " , the exclusion set 
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may be updated to r£' = {2} in the next iteration i+1 , such that the calculation of the 
new would only consider 4 i.e. 

/ei a «.{2.6}\I^=|2p /eZ#={2,6)\I#=(2) 



As can be seen in the example above, if. the value a' n were unreliable, the resulting fi a 

* 

value could have been forged by the unreliable message matrix element . E.g. 
assuming that a' 26 correctly indicates a positive sign but would indicate a negative 

» ♦ 

■ • * 

sign, the resulting fig would have been assumed to be negative in its sign as well. 
Thus, when determining a decoded codeword x according to equation (6) a wrong 
codeword x may be obtained if one or several of the fi™ elements are corrupted in a 
similar manner. 

« 

Exclusion sets may be defined in order to exclude data from the equations (or decoding 
process) which are assumed to be wrong, or which aire highly likely to be wrong. Another 
possible definition criterion may be whether a message matrix element or value may 
provide a contribution to the decision process. E.g. if an LLR value is close to 0, this 
means that both events represented by this LLR are almost equally likely, such that no 
information (or only little to be correct) may be obtained from this value with regard to the 
correct decoding of a codeword. 



If such data is included, the produced output is likely to be wrohg.as well. Therefore the 

■ * 

present invention proposes to neglect such values from the equations as disclosed 
above. 

As mentioned above, the exclusion sets for the new horizontal and vertical steps should 
be defined such that unreliable messages are excluded from the calculations. It should 
be obvious to those skilled in the art that the exclusion sets may be defined 
independently from each other. In other words an element of exclusion set r^, does not 

* 

necessarily be element of exclusion set €l mn . 

Similarly the exclusion sets may be set independently in decoding iterations. Those 
skilled in the art will recognize that with increasing number of iterations, the overall 
reliability of messages passed may be increasing for reasonably good transmission 
conditions. Therefore with increasing number of iterations the number of elements of the 
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exclusion sets may be reduced, such that at late stages of decoding the exclusion sets 
may be empty. It should be noted, that the exclusion sets may depend both on the 
n number of iterations processed so far, as well as on the maximum number of decoding 
iterations, which may be a parameter given by the communication system. 

■ 

A list of possible criteria which may be used isolated or in combination for determining 
the exclusion sets is provided in the following. One parameter on which the reliability 
criterion deciding whether a message matrix element is comprised in exclusion set or not 
may be results from channel estimations. The channel conditions for each bit of a 
received codeword do not necessarily have to be similar, e.g. in case of employing 
OFDM (Orthogonal Frequency Division Multiplex). In such a system the different bits of a 

« 

codeword may be transmitted on different suhcarriers of a subcarrier set (channel). 

, • ■ 

Hence, different channel conditions on the subcarriers may exist. As a measure for the 
channel conditions the SNR (Signal to Noise Ratio) or related quantities may be 
employed. 

• • * 

Another parameter on which a reliability criterion may be based on is the absolute values 
of the measures involved in the horizontal or vertical step, i.e. the log-likelihood ratio, the 
likelihood ratio, a likelihood difference, a log-likelihood difference, and/or another 
probability measure. As outlined above for LLR values, an absolute LLR value close to 0 
may not provide any significant information for the decoding process. 

♦ 

As outlined above as well the iteration number of the decoding process may also provide 
a basis for a reliability criterion to determine the exclusion sets and Q^, . Another 

* • ■ 

alternative basis may be a random process deciding which of the available message 
matrix elements should be included in the exclusion set, i.e. which of the message matrix 
parameters are excluded from the calculations in the horizontal and vertical steps. 

* 

m 

It is further noted that the reconstruction of a codeword jc may be performed after each 
horizontal step, such that the vertical step is only executed if the decoding procedure 
should be continued. Those skilled in the art will recognize that this is an 
implementational detail of the algorithm which does not affect the computational results. 

As will be shown in the following section the ideas underlying the present invention may 

« 

also be applied to decoding methods in which the calculations performed in the 
horizontal and/or vertical steps are based on a (log-)likelihood difference. Such a 
decoding method is for example known from WO 02/37731 A2. The exemplary system 
defined therein defines the horizontal step as: 
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>.(o)-*(i+lW) 



(16) 



(17) 



and the vertical step as: 



fe(o)-a.j*(o}[p>(°) 

7*1 



(18) 



(19) 



According to the present invention, a new horizontal and vertical step may be defined by: 



(20) 



V 



(21) 



for the horizontal step and by 



? ft (o)=^A(o)n^(°) 

Jen* 

9.6)-a ; A0)n i >0) 

yen* 



(22) 



(23) 



for the vertical step. 

■ 

The notation used in this embodiment of the present invention above is similar to that of 
WO 02/37731 A2, except for the exclusion sets r and Q , which are used as described 
in the present invention. Sg lk refers to the difference between the probabilities that the i" 1 

element in the k m row is a "1 " and a "0", i.e. Sg lk .= g lk (1) - qik (0) . 
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Further, is the prior probability that the k" 1 bit of the received codeword is a "1 " (i.e. 
k=1..N). Accordingly, p k (p) is the prior probability that the k" 1 bit of the received 
codeword is a "0". Hence, in the example algorithm given above, the two probabilities 

correspond to the initialization data X n , or in more detail X = ln^^.. In equations 16 
through 23, or is a scaling factor chosen such that q & (1) + q & (0) = l . 
To decide whether a bit in the codeword is a "1" or a "0" the equation 

fl Jbrq k Q)2>q k (p) 



x = 



0 forq k (l)<q k (0) < 24 > 



may be used where 



1 k (0) = a Pk (p)- JIM 0 ) (25) 



and 



ftO) = a-A©- Il^O) (26). 

Atter having discussed the underlying ideas of the present invention in detail, the 
following section will describe preferred embodiments of decoding processes of the 
present invention. 

Fig. 3 shows a flow chart of an exemplary decoding process according to an embodiment 
of the present invention. In a fist step 301 , a counter / for counting the iteration of the 
decoding process may be initialized. Next, the message matrix elements a mn may be 
initialized 302 e.g. by using the receiving means estimate of each codeword bit X in 

n 

form of an LLR value and the exclusion set r.,, may further be initialized based on 
parameters, e.g. a SNR value, indicating which of the codeword bits X n fulfill a reliability 
criterion as defined in the previous sections. Optionally, in step 302 the exclusion set 
fl » ma Y further be initialized e.g. by defining an empty set or by including the elements 
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Taking the example of using likelihood differences as a probability measure, as 
described above, the initialization may be performed similarly. Instead of using the input 
data A n , the receiving section may provide the probabilities p k (0) and p k (1) which may 

be used to initialize the quantities $ tt (0)and. In this example decoding process 

g a (0)and £#(1). may be considered as corresponding to the usage of the message 

matrix elements during initialization. 

Upon having initialized the message matrix elements and the exclusion set f the 
message matrix elements fi m of the horizontal step may be calculated 303 according to 
one of the equations (13) or (14) while taking into account the exclusion set r., . 

* 

* 

When using likelihood differences as a probability measure, step 303 may correspond to 
determining the measures r tt (0)and r tt (l) as suggested by equations (20) and (21), 

under consideration of the exclusion set r . ' 

Bin 

■ 

According to this embodiment of the present Invention, the decoder may next try to 
reconstruct the received codeword Jc, e.g. by using equation (6). Accordingly, equation 
(24) may be used when employing likelihood differences. 

Next, it may be checked whether the reconstructed codeword x satisfies 305 the parity 
equations, e.g. by checking whether Hx = Q. If all parity check equations are satisfied, 

m 

the decoding process may be stopped 306 and the successfully reconstructed codeword 
x may be provided to a further processing entity in the decoder. If at least one of the 
parity check equations is not satisfied, it may be determined if the maximum number of 

* 

iterations as been reached 307. If so, the decoding process may be stopped 308 and a 
decoding error may be indicated. 

■ 

* » 

If the number of iterations has not reached i mgx the exclusion set Q^, may be determined 

» 

309 based on the calculated message matrix elements and/or the respective 
reliability criterion for each/the message matrix element/s. 

* 

Using the determined exclusion set Cl^ new message matrix elements may be 
calculated 310 based on equation (15), which corresponds to the vertical step. When 

♦ • 

employing likelihood differences, equations (20) and (21) may be used to calculate the 
new r rt (0) and r tt (l) values. 
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■ 

* 

Upon having determined the new message matrix elements (or the new > tt (0) and 
r tt (l) values) the exclusion set may be Updated 311 accordingly. Upon incrementing 
the iteration counter 312, the processing may continue by calculating new values as 
outlined above (see step 303), 

■ 

Next, a further embodiment of a decoding process of the present invention will be 

■ 

outlined in reference t6 Pig. 4. Fig. 4 shows a flow chart of. another exemplary decoding 
process according to. an embodiment of the present invention. The initialization of the 

» * * 

decoder as shown. in steps 40.1 and. 402 correspond to those known from Fig. 3 (see 
steps 301,. 302). Also the calculation of the fi in step 403 may be identical to step' 303 
of Fig. 3.. 

• ' . • ' • ' • • ' ' ' " "■ 

. in contrast to the decoding process known from Fig. 3, the. decoder does not try to 
reconstruct a decoded codeword x in. each iteration step, but a number of, iterations are 

* * 

performed (see steps 403 to 408) first before trying to reconstruct codeword, x 409. 

. ■■ - *. * 

- • 

• • • 

Upon having calculated the p mn in step 403, it may be determined if the maximum 

number of iterations as been reached 404. If so, the decoding process may jump to step 
409. • ■ • 

■ 

If the number of iterations has not reached i max the exclusion set n^, may be determined 

• - ^ • 

405 based on the- calculated message matrix elements and/or the respective 

reliability criterion for each/the message matrix element/s.. . 

'-•".•'»' 

Using the determined exclusion set Cl^. new message matrix elements cc^ may be 

i » 

calculated 406 based on equation (15), which corresponds to the vertical step. When 

• • * # • 

employing likelihood differences, equations (20) and (21) may be used to calculate the 
hew r tt (0) and r^(l) values. 

* m • 

• m 

Upon. having determined the new message matrix elements a^' (or the neto /^(O) and 
r a (1) values) the exclusion set may be updated 407 accordingly! Upon incrementing 
the iteration counter 408, the processing may continue by calculating new 0^ values as 
outlined above (see step 403). 

■ ♦ 
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When exiting the iteration loop, i.e. when the iteration number / equals i maXi the decoder 
may reconstruct a codeword jc 409. Further, it may be checked 410 if the reconstructed 
codeword jc fulfills the parity check equations represented by parity check matrix H. 

If all parity check equations are satisfied, the decoding process may be stopped 41 1 and 
the successfully reconstructed codeword jc may be provided to a further processing 

* 

entity in the decoder. 

If at least one of the parity check equations is not satisfied, the decoding process may be 
stopped 308 and a decoding error may be indicated. Alternatively, the counter # may be 

m 

reset and the maximum number of iterations may be reconfigured l max and further 
iterations according to steps 403 to 408 may be performed, before trying to reconstruct a 
codeword x again. * 

Next, Fig. 5 will be discussed in more detail. Fig. 5 shows a transmitter and a receiver 
unit according to an embodiment Of the present invention. The transmitter 501 comprises 
an encoder 502 and a transmission means 503. The transmission means may comprise 
a modulator for modulating the signals encoded by encoder 502. As indicated by the 
dotted arrow, the encoder 502 is capable of encoding input data into codeword suitable 
for decoding according to the various embodiments of the decoding process. The 
modulated data may be transmitted by the transmission means 503 using an antenna as 
indicated. 

The receiver 504 receiving the encoded signals may comprise a receiving means 506, 
which may comprise a demodulator for demodulating the received signals. Upon 
extracting the X n values and parameters in the receiving means 506, these data may be 

■ 

provided to a decoder 505, which will consider the data to initialize the decoding process 
as outlined above. 

The decoder 505 may comprise a processing rineans 507, adapted to decode the 
received data according to the methods described to produce reconstructed codewords. 

* 

« 

Fig. 6 and 7 show a mobile terminal 601 and a base station (Node B) 701 according to 
different embodiments of the present invention, respectively. The mobile terminal 601 
and the base station may each include a transmitter 501 and a receiver 504 as shown in 
Fig. 5 to perform communications. 
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« 

•# 

Fig. 8 shows an architectural overview of a communication system according to an 
embodiment of the present invention comprising a mobile terminal 601 shown in Fig. 6 
and a base station (Node B) 701 shown in Fig. 7. 

• » 

The overview depicts a UMTS network 801*. which comprises a cdre network (CN) 803 
and the UMTS terrestrial radio access network (UTRAN) 802. The mobile terminal 601 
may be connected to the UTRAN 802 via a wireless link to a Node B 701 . The base 

* « 

stations in the UTRAN 802 may be further connected to a radio network controller (RNC) 
804. The CN 803 may comprise a (Gateway) Mobile Switching Center (MSC) for 
connecting the CN 803 to a Public Switched Telephone Network (PSTN). The Home 
Location Register (HLR) and the Visitor Location Register (VLR) may be used to store 

» * 

■ 

user related information. Further, the core network may also provide connection to an 
Internet Protocol-based (IP-based) network through the Serving GPRS Support Node 
(SGSN) and the Gateway GPRS Support Node (GGSN). 
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■ 

* 

A method for decoding at least one codeword comprising n code bits in a 
decoder, the codeword having been generated in an encoder using a set of m 

• m • 

parity equations presentable as a parity check matrix, the method comprising 
the steps of: 

a) for each non-zer6 entry in a parity check matrix, initializing the message 
matrix, elements of a first message matrix with data obtained from a 
demodulator, 

• • • 
„ . . • 

« ■ 

b) for each nbn-zfero entry in the parity check matrix, determining the 
elements of a second message matrix based on message matrix elements 

of said first message matrix, and 

, * • 

• * 

c) reconstructing a decoded codeword based on the data obtained from the 
. - . - * * 

demodulator and the message matrix elements of the second message 

matrix, 

- * m • » 

* 

characterized in that. 

• ■ * 

• ♦ 

• * • 

a subset of message matrix elements from said first message matrix is used 
for determining a message matrix element of said second message matrix, 
wherein the message matrix elements of said subset fulfill a reliability briterion. 

The method according to claim 1 , characterized by further comprising the 
step of: 

« 

d) updating the message matrix elements of the first message matrix based 

# ■ . * - • * • 

on a subset of message matrix elements of said second message matrix, 

* * ■ * 

wherein the message matrix elements of said subset fulfill a reliability 
criterion.-. 

A method for decoding at least one codeword comprising n code bits in a 
decoder, the codeword having been generated in an encoder using a set of m 
parity equations presentable as a parity check matrix, the method comprising 
the steps of: - • 
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a " m 

. ... . • 

a) for each non-zero entry in a parity check matrix, initializing the message 
matrix elements of a first message matrix with data obtained from a 
demodulator, 

* 

• * 

b) for each non : zero entry in the parity check matrix, determining the 
message matrix demerits of a second message matrix based on message 
matrix elements of said first message matrix, 

• * , 

c) reconstructing a decoded codeword based on the data obtained from the 
demodulator and the message matrix elements of the second message 
matrix; and 

■ 

■ m ■ 

■ 

d) for each non-zero entry in the parity check matrix, updating, the message 

• - * t . \ 

matrix elements of the first message matrix based on message matrix 

elements of the second message matrix, 

• • ... 

characterized in that 

* ■ , 

* • 

* » 

a subset of message matrix elements of said second message matrix is used 

• a « 

to update a message matrix element Of said first message matrix, wherein the 

message matrix elements of said subset fulfill a reliability criterion.. 

: ' % ' ".. ; ■ " ' ■ • 

. The method according to claim 3; characterized in that a subset of message 

matrix elements of said first message matrix is used for determining a 

• * ■ • ■ 

message matrix element of said . second . message matrix, wherein the 
message matrix elements of said subset fulfill a reliability criterion. 

• • • » » 

• • • • 

The method according to one of claims 2 to 4, characterized by further 
comprising the step performing iterations by repeating steps b) and d). 

The method according to claim 5,. characterized in that the step of 

* • 

performing iterations further comprises the step.of repeating step c). 

■ 

The method according to one of claims 1 to 6, characterized by further 

. . ■• • • 

• comprising the step of:- . 

e) checking whether parity check equations of the parity-check matrix are 
satisfied by the reconstructed codeword. 
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The method according to claim 5 to 7, characterized in that the iteration is 
stopped upon reaching on predetermined number of iterations or in case the 
decoded, codeword satisfies the parity check equations. 

■ 

The method according to one of claims 1 to 8, characterized in that the data 
obtained from a demodulator comprises parameters representing one of a 
likelihood ratio, a likelihood difference or a probability for each of the n code 
bits of a codeword. 

* 

The method according to claim 9, characterized in that the data obtained 
from the demodulator further comprises indications which of the parameters 
fulfill the reliability criterion. 

The method according to one of claims 5 to 10* characterized by further 
comprising the step of updating the subset of message matrix elements of 
said second message matrix used to determine the message matrix elements 
of said first message matrix upon determining new message matrix elements 
of said second message matrix in an iteration step. 

The method according to claim 11, characterized in that in the step of 
updating the subset, the updated subset comprises only message matrix 
elements of the second message matrix fulfilling the reliability criterion. 

* 

♦ ■ • 

The method according to one of claims 5 to 12, characterized by further 
comprising the step of updating the subset of message matrix elements of 
said first message matrix used to determine the message matrix elements of 
said second message matrix upon determining new message matrix elements 
of said first message matrix in an iteration step. 

* 

The method according to claim 13, characterized in that in the step of 
updating the subset, the updated subset comprises only message matrix 
elements of the first message matrix fulfilling the reliability criterion. 

• * ■ 

• « 

The method according to one of claims 1 to 14, characterized in that the 
reliability criterion is based on at least one of channel estimations of a radio 
channel via which the codeword x has been received, the absolute values of 
the elements of the first and/or second messagematrix, the absolute values of 
the data provided by the demodulator, the number of iterations in the decoding 



27 

■ 

which have already been processed, the maximum number of iterations to be 
performed in the decoding process, and a random process. 

16. The method according to claim 15, characterized in that the reliability 
criterion is not fulfilled by a message matrix element of the first or the second 
message matrix, if the signal to noise ratio for the element and/or the absolute 
value of the element is below a predetermined threshold value. 

17. The method according to one of claims 1 to 16, characterized in that the 
error correcting code is a low-density parity-check code. 

* 

18. A decoder for decoding at least one codeword, the decoder comprising 
processing means for: 

■ 

a 

initializing the message matrix elements of a first message matrix for each 
non-zero entry in a parity check matrix with data obtained from a demodulator, 

* 

• « • 

» 

determining the message matrix elements of a second message matrix for 
each non-zero entry in the parity check matrix based on message matrix 
elements of said first message matrix, and 

■ 

reconstructing a decoded codeword based on the data obtained from the 
demodulator and the message matrix elements of the second message matrix, 

characterized in that 

• * 

the processing means is further adapted to use a subset of message matrix . 
elements from said first message matrix for determining a message matrix . 
element of said second message matrix, wherein the message matrix 
elements of said subset fulfill a reliability criterion. 

19. A decoder for decoding at least one codeword, the decoder comprising 

processing means for: 

■ 

initializing the message matrix elements of a first message matrix for each 
non-zero entry in a parity check matrix with data obtained from a demodulator, 

* 

■ 

* 

determining the message matrix elements of a second message matrix for 
each non-zero entry in the parity check matrix, based on message matrix 
elements of said first message matrix, 
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reconstructing a decoded codeword based on the data obtained from the 
demodulator and the message matrix elements of the second message matrix, 
and 

updating the message matrix elements of the first message matrix for each 
non-zero entry in the parity check matrix based on message matrix elements 
of the second message matrix, 

characterized in that 

* 

the processing means is adapted to use a subset of message matrix elements 
of said second message matrix to update a message matrix element of said 
first message matrix, wherein the message matrix elements of said subset 
fulfill a reliability criterion. 

The decoder according to claim 18 or 19, characterized in that the decoder is 
adapted to perform the method according to one of claims 1 to 17. 

A mobile terminal in a mobile communication system, comprising: 

■ 

receiving means for receiving at least one codeword, 

• » 

■ • 

demodulation means for demodulating the at least one received codeword and 

* 

for data to a decoder, and 

a decoder according to one of claims 1 8 or 1 9. 

* 

The mobile terminal according to claim 21, characterized by further 
comprising coding means for encoding data in at least one codeword, and 
transmission means for transmitting the at least one codeword, and in that at 
least one transmitted codeword is suitable for decoding according to a method 
of one of claims 1 to 17. 

A base station in a mobile communication system, comprising: 
receiving means for receiving at least one codeword, 

■ * * 

demodulation means for demodulating the at least one received codeword and 
for data to a decoder, and 

a decoder according to claim 18 or 19. 
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The base station according to claim 23, characterized by further comprising 
coding means for encoding data in at least one codeword, and transmission 
means for transmitting the at least one codeword, and in that at least one 
.transmitted codeword is suitable for decoding according to a method of one of 
claims 1 to 17. 

A mobile communication system comprising at least one base station 
according to claim 23 or 24 and at least one mobile terminal according to 
claim 21 or 22. 
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■ 

The present invention relates a method and a decoder for decoding codewords 
generated in an encoder using a set of m parity equations presentable as a parity check 
matrix, wherein for each non-zero entry in a parity check matrix, the message matrix 

m 

elements of a first message matrix are initialized, with data obtained from a demodulator, 
and the elements of a second message matrix are determined based on message matrix 
elements of said first message matrix. Further, a decoded codeword is reconstructed 
based on the data obtained from the demodulator and the matrix elements of the second 
matrix. Moreover the present invention relates to and to a communication, system, a 
mobile terminal and a base station comprising the decoder. To reduce the influence of 
wrong information the decoding method uses subset of matrix elements from said 
first/second: matrix for determining a matrix element of said second/first matrix, wherein 
the matrix elements of said subset fulfill a reliability criterion. 
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